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\ 'ABSTRACT 



— : r^S^veritl~re^5earch^^hir»r"cjrie^^ inadequacies : 

in jnariy "Idcai" attrition StudiesV Given: the eurrent eohcerh witS maintaininl; 
stable ehrdl Irriehts, however, it seems 1 ikely that aSministratprs wil 1 continue : • 
to call for studies of attrition en tfiei^^^^ describes three 

basic designs for studying college student attrition and discusses the cofnpafative 
assets-and liabilities of eachi .''Autopsy,'' cross-seetibhal, and longitudinal ' ; , ' 
dels igns are evaluated with respect to ^uch cbnsideratiiPns as likely response rates 

. - ■ » • ' ■■ - ■-. '"' - ■'' ■ - - ■ ■ ' ■ ' ^ \ 

and sample representativeness, controls for confounding variables, desipabje 
analytical procedures, t'ime^lines, relative costs* and applidability of 'dala to 
other purposes. The paper is intended' to facilitate the edst-Beriefit judgments ' 
inherent in the decision to undertake an attrition' study by highlighting the 
research and practical ti^ade-bffs required by the ^selection of a particular design. 
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- : 0^^^^^^^^ AN EVALUSTION OF 1^^^^ ' , ^ : ^ 

edtjcdtidrial adniiriistriters and plariners ■ find 1 tt^^ tfie :;evidence suggestf^^ - 

that national four-year around ,50 . . 

'"'per cgnt over tte las^ or s>x1;y years >(Sume^^ v 
' Whi l,e^ some attKi tion is i nevi tabl e ^ and sbiiie^rna/ *eve>i be .desi rabl e i 1 eadi hg to i . - 
or reflecting, positive developental^b^ some students,); the fact renains 

that federal, state, institutional, and tfidivi dual resources a^^^ 
students ^ho ultimately do not complete a ^degree program as we^ in those who 
Ta the extent that stime students would ntfce to remain in 3chbbl bat eahhbt, 
and Irb the extent that the reasons fdrTdiscbriti nuance are within; the sphere of 
federal, state, pr institutional influence, then s.ueh investments may represent 
both mi sexpended resources and neglected educational responsibilities. 



Several excellent reviews of the attrition literature Sxist (Spady^.. 1970; 
Ti ntor 1975; Cope & "Hannah^ & eree^dpn i^^ 

and .various national studies, useiful as they are for general understanding of the 
attrition phendmenoni in no w5y dbviate the need fdr "Ideal" .research. Indeed, [ 
recent federal regulatibhs requiring ihstitutibhs to provide applicants with in- 1 

^ _ ? _ ■ * _ _ _ '■ , ^ :■ '■ _. ■ _ . " \ 

formation aboat institutional completion rates can'reasonably be expected t-o increase, 

^- - - ■■■ r \ ■ . , . ^ \ 

rather than diminish^ the number df "local" attritidn studies. It seems equally 
Tikely that mahy^administratdrs ^iil not be content simpTy with knowing how many > 
students drop out, but will also want information, about wfe withdraw; 
Yet single-institution studies have been roundly criticized as methodologically^ 
uneven* as based on inadequate defihitidns^ designs i sppling plans, jnstrtlmehts, 
and analytical procedures. ^ ^ . v V ' 



..Program or policy action based on unreliable or invalid research may- 

" - . • . ^ • ' k. - ■. ■■■ 

less effective; than that rooted in administrative Ifrtiiitlon. If campus officials 



• * 
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.tire W conduct' Useful atirklon studies--OT felnforttietf- consuniirs^^^ d research V 
of others--there appglrs,:4o b^^ Heed fer a eeparisbh of the relative 'stren§tRs 



^and^wSaknesses^^ 

< for; stqdi^i ng a ttn 1 1 on ; \ Thi s paper ' attempts to: meet that need ... at 1 eas t i'i n part * . 



by i) -.descri bi ng. ihree basic 



designs study ing^^bllege studerit attrition— the * 
"autofssys" cross-sebtlonaT, and Idngittidfnal designs,. and 2) evaluating the ; 
assets and Tiabi^ities inherent in , each. . ; . i 

Some PrelimihaW Cohsidera-tidh's ^ ,'. ' • ' - ' . ' y '.. .^: : ^' : ■ 

. ' Before selecting a suitable; study design, careful attention needs to be 



given _to -what is m^ant by "attrition." ^ The definitional task:is-complica 

the wide variety of types of dropping out and by the -frequent. hybrids, of eommdh 



i^n 



t^pes. For example, drdpping out may be: 1) systemic" (i.e., a complete cessati 
of pdstsecdi^ary edueatibri) or institutional ^withdrawal -from one ihstilutfon, but 
enr^l1nint/at anpthe perhaps, no *interruptiDn in stu^ . 



. (this .so-called: "^^^^ 3) foreed ^the aeaderriie disitfi^isal) or 

vd^i^ht|iry; or 4)^>tihantieipated (:i.e'., ho i5re-enrollmefit ex^^^^^ out) 
or planned (e.g., when .specific^ non-degree, educational or persona] gpals have been ^ 
accompliih^d). Jhere is ample evii^ence of behavioral' ahd attitudinal •dif^^ • / 

-among students across the varidus fypfes (Prediger, 19^5; Rose ton, 1966'; ft6s|pa"n ■ 

The protjl em deselecting clear, exhaustive., and mutually exclusive definitions. 

-- -- - -1 _ - - ■ V-' .'^i. ^ >' - - . " 

is compounded by considerations of the ■pdpulatidn df "students un^er study (Is a^ttritiorf 

- - . ■ . ' - - .. i < " -:' . . ■ _ 

at a single, several, dr all el elss levels td be studied?), and by 'the time periiod 



edvered by the attrition rate (Is on? concerned with -attrition after one' semester? 



- i- 



a year? four years ?^ ten s^r^l) ^Re^pjputidn of one issue niay limit Si terhatives iK 
the other, for example^ Kfeland (1964) ^ 'Sexton (1955), and, Pahtages and ereedoh (1978), 
aitjofig bthersi suggest ^lat most students whd .withdraw do so before the start of the - 
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sbpfibnibrfe'yeari Yet studies of , f res fiffian a^^^^ no. informatioh ■ 

' \ ?«b6ut the.* ^ out over different classes or a Idnger time period. 

' t he^^ie sign descri[ftions and as s^s sitien ts that follow a^§ utne -th at surveys 
-iS^search niethods^r^^ pestiphhaires rather than'^pefsohial : ihtervH^ be ' 




employed! although the latter argi hot prjecluded. V Although it ts^'also assumed tha 
f studies will* probably be ^^^^^^^^^ on^ random samples of students/ smalferiiiis titUt ions • . 
may seek- to survey whole pbpulationsr. T^ihallyV the ev^^ single- ; , 

.Tristitutibh studies; adaptatioris^ td larger systems will be mor^ dries of scale 
. than of cdhceptiori. . ■ • J^- : ^ ^ , ' 

/ the three a^^ltion study designs are eval^ maabr clashes, 

bf issues Res earth' tons ide^^ CdnsideratijDris." E^^ df these " 

Classes comprises a set df mdfe specif icVpoints td be intb account in select- 

Trig the most appropriate "design for a s^udy, given , the questi^s to be answered 
and ^the constraints imposed by available resources T: "Research Considerations s" 
„:_-V4ewe^ 

to those methddd1dgica]^;^gr^^t^^ would sfeek to ma)?i there were rio. limiil 

bh tim^ br resources. "Plahhirig CorTsiderations "cost" areas to be , 

" taken int6 account as research obaecti.ves^are Balaoced -^^^^ 
time, persQririel, moriey, arid other resdurcpsi*: Table l^surm^^ design's 
evaluation in these general areas ,afld -butHnes" thf^^^^^ in selecting 

a particular research design. - . . > ' \ A - 

In. Table 1* " Instrument Reliability" and Iris tru listed under 

^Research GdrisiderationSi are clearly mdre matters. of measurenieh than bf design. ' 

• » . • ■ . . * , ■ , ■. . . ■ ■ • 

Chbice bf a desigrf neither precludes ri adequate^ instrumentation, a^ . ^ 

'the quality of a measure *3s more closely related to the kridwl edge and skill of the ; 
researcher than to the desigri; selected, th^y are iricl tided ridriethel ess BeeSuse they ' 
are ^impdrtarit eonsri derations in ariy research. ' C 



"Exit interviews" are not discussed 1) Because their primary purpose is^p : 
liibre for eburiselirig th^ arid 2) because most drbpbuts appear 

: between,, rather than witlrin^ semesters; arid dfteri without ridtice df their departure. 
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' SUMMARY EVALUATION' OMHSEE- DESWm 
FORSTUDYING-ATfRn^^ 



eoiisidefsitibn 




^fopsy TGross-SectionaT, T-ongi'tudinal 

Studies : Studies ' | Studies 



)nsideratio a is : 



Ihstrcimeht Reliability 
Instrument .Validity^ . 
Likely Response Rates 
Sample^ Represeh tati veness 
Internal Validity : ^ v 



.Probably timited 
Protiably Limited 
' ' 15^0% . 
Unlikely 



Possible 
Possible' ;■ 

Mor^ Likely 



a) Comparisons with Non-dropVut§ 



b) Controls for Initial Group * 
Di#fjerences 



No 
No 



Yes 
Li mi ted 



e 



Analytical Procedures' 



: -Usually Descriptive 
or Bivariate 



B\mr\A ng Xoh s i de rat i bgs^ ( Costs j 
Iteeded Training/^pen 



Minimal 



to Eompletel Study 

Direct Costs (Re natively) 

Planning J^eded 

*App1 i cabi li ty of Bata to 
Either Parposes " 

Data^ahagement Proble and 
remerits . 



3-5 mos, 



Limited 
None-Limited 

Tew ' 



Biyariate or 
Multiya,riat6 



_^ ; -MbderSte-4:o--- 
% Atdyanced; 

. . i-9 mp§. 

> ^oW^Moderate^ 

Llmiled-Mdd^erate 

Moderate-High 



Possible 
Pcissible 

More L;ikely 

.Yes > 
Yes 

Multivariate 



1^ ntos , 

jpdrisiaerablS 
Moderate4lfgh 



Few-Moderate Modera\e-^Mar@f^ 



Depends more on the training and sl<:il l of the 7erson(^^ designing the study ' than on 
the design adopteid. . ' . ' ' / 

Response rateSi expressed as propprti bps of ah initial sample, cfecline with each 
■subsequent data ebllection. ^ "V _ : . ' ^ 

^' ■ " . . ■■ ■ y \ ,"'. '. '■}' '■ ■ ; ' . - : . : ', , v ' ■ - 

-Ass.QTO^^ information, available fo^r^^^ study* respondents is 

.that typically cpll^ time of applicatipn for admissidns (e.^ sex^ academic 

;,aRtTtude, percentile rank in high schooT class ^ but not including, educational- 

aspiriitibns^ or p^^^ to cdmpletirig a degree;, persbhality ch.aracterfsticsi 

^anid similar irifbrmatib^ 
- . . ^ • ' « "•" ■ ■ ■ ■■' * " - \ ■ ... 

Gests: jiiay be reduced cdhsideraBly if an fnstitution regularly collects extensive pre- 
. college data through such: programs as the Cooperative Institutional Research Prdgram 
. MUCLA-' 4 ACE-spbnsoped) or the ACT. Assessment Program. • •" 
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. ^ ./ ■ ••' • " , / ffiE "AUTOPSY r-DES^^ . ^ 5 V : ; 

: "Autopsy" (sometimes ca^l ed "retrospecti ve" ) studies Involve an after-the- 
fact sarvey of the reasons droiJOtits give for disebntintilng their studies;' yndef" : 
ii^j^des^W^dropouts^^^^ 
and s^nt a questionnaire.on whiW^ they left school , and some- v 

times their college experierfees Jiiri^ thrir eyaluatfie^ iristitutipnal program^ 
•'and*' services; ^ , -y- ■''■••v' .■ ' ' ^•; • 

The autopsy design affbrds an bppp^^^^ students:' own ^ * • 

words why th^ withdrpw^ vJh^at t^ remain y'1;hei> curre 

aetiviti^, arid their future^ij^ltToria^^ one can sepat^ate those 

students who dropped out because"©? sbme;^^^ 

who had/^Tt^^^pl ished their educational "^goals^^ Conirared to the other designs to 
bie discussedr only the autopsy, st^^^ such opportunities, 

This'd^si^ri seems straight forward enough: if ^bu wSht to fcriowswhy students 
-^di^op out rask thpTT^^ Rbwever, i^ HaBili ties. far 

outnumlier its assets. » Insjtrument reliability. cannot easily be assessed -si qjce^mpst 
of the quest ions are typically written to -'^nd aid to Be groupe| together 

in factors or scales that reflect Jn a more stable manner sorhfe bef;iayioral oi^'r^'^- '< . ■ . 
attitudirial dimension tiia*-pay be related ta attritibnv: ^Ifistr4jmirit:\^^^ 
also prdbatfiy compromised^ studen1:s wht) have left 

need, tl rati briali^e the>ih decision^ to make it sb&i ally v even pe^^^ ac^eept- 



able (e.tj. , Knoell ,-1966; Fehstemaeheri 1973)./ - ► . . . « 

/ In addition tO; these problems^- ^ 
noidriously Idw, hdt infrequently telbv*^^^ : 
rate is not in and of itsel f^a. threat to. a s t^^ T ^ 

rates are directly related vta the likel ihood'pf response represent tiis^^ ' \ 

lower the' rgsponse rate^ the less>*likel Ihood of respondents being representative - 
Gf /lhe larger pblDtilatibt) from which they: tome. fl^ (1973,) data 

indiGate* this unrepreseri^ttye on thi personal -characteristiGS^ 
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' pf dropouts and dn tfietr evSluatibns:pf t^^^ : 

^ • (Tfkely td" be biaseb In a positive ''direction). Thus, generaiizabiii^^^^ ' ; \ ' 

—■ — H: — '■ — :- '■ : — '■ ^— ^ : ; \ \ : \ — : 1 : — ■ — r^. ' ; — \ ; ' . ^ — ■ \ t"* — \ 

\ ' Moreover; /as Gampbeli an^ hav^^hoted:. --^'Basie^ to seieHt4|ft: : 

evidence. . Js th^ process of cbSparison, of recording dif^^ orfof coritras|.-; 

\ SpcuHng •scientlHq one comparison" v(p. 6)., 

' ffiis notion of eohtroTled eomparisbh is; furidafnerital to any research desS"gn:'*s •; ■ - 

■ ' in^fnal \raTidjty-r.^^^^ tfie design td^assttre that an observed relation : 

v^e^l-g^** between aeadeniic nfejor and attrition) is not a spdrious one. Basicallys . ' 
. . " there are two validity may be enhanced: through ^ 

. the vratiionf askighmeTit of persons to e^perj'merital and control groups, dr. 2)thftiu.gh 

■ the use .of non-equivalent the adoption oif statistical - 
. • contro^^ (including faGtorial designs) to take initial group differences^ into : .^^^^^^ ; 

, ' ■ V :: ii!(hile np attrition, d^ the autopsy " 

study design (of those disbussed here) also fails to provide fdr a^.grdupv.of non-- r ^ ' 
dfdpouts with whoitt the dropouts can- be conipargd 'in the search for vai^iables that • r 
are related to ; aftritioa; ^^^^^^ the absence of a eomparisoH "groups ^ot^ 
; s descr>be^^oppu^ chara^tif;i^stiGS, attitudes or' behavidrsr--tratt^ -that may 

■ ■;■ njaj^^ not be simijiar to those of nonj^dropouts; ; And clearly,vwitlibutra;c^ 

/ VqS^Pj $ta^^ cdhtrbls bfecdme itieariiri -^ l: ■ . ; 

^ while it ;js not a; weaRness i^jjher^ent in. the des:ign, autopsy studies 

ty^ptcalty^^^^ on frequency distributions and cross-tabulatiocis for i^t is tidal 

■ description of -results.' Wheii .stattstica^^^^ niades * they are most'- f^^ 

, ■ . ■- - ~ ■ . ' ■ ■ -■ • ■ - .•■.-* . :■ - * . . - S- • • . 

Based dn biy^lriatfri^^p^^ bistween tw§ varixfM '^fle^^^ " 

thesercbnditiqns,.a?e mp^^^ than ndfc reMt^^ ■ 

-■■ ■ •■ ■ ^-.•■v:,/.!;.- ■ " . x \ '[ M - u^x^': --^-' '■■ \ ^ ^^^^^^ ;>;^ .»:vV;;;- 

; Data can be eolleet^flrpS^^ although th^ 

I;, ttoi) ;is^li k§l*^J^ hov^*er^^1:d^b^ timesH'aJld urfder different - 

CQndi:tiPns than tha^t^^ ■ \: '\..:r''i-'''i^^^ ^Vi " ^ : 
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^Jr expeViertce Of the researb of taking into 

\ : aeddunt the' epnipj^^^^ of interrelation whi:eh bh^ senses 'Ifltuiflv^ 

• Tie t h e attritiorl prbcesg. : .Repegrt^ Ihdeedl ■ v-- 

i:^ Spady ^1970)^ that V. //furthSrV. .biv^^ on the -'cgrfyia^^^ 

:S : of d*^^ abanddn«i.^ Npw!'\ tp^^ ''/^ ■ ^ 

: If>tlhe research asset^:;^^^^^ design ^aPe m^g^r, . t^e planning ^ 

'[• v.. Gons^^er^ jtiinimai ^he- training-^ 

' ^tequi^ed to cohd^ ;Such>a *studj/^ ^re 



to. discussejl.. ; Adrnin^strati;ye at)il it;^^ to coord inate the/development' 

and" prdduetidn of, a questtohnai re: vth| ^^Kt^^ InKereit *ih research ^ 



• jL-i-^ ^ - ^- - 



; . ; ^6tit the servjces 0? a fuJl-time researcher^/ ari^ riot 
- ; ■ consultation with someone f ami 1 iar wtK stati.stiGs and sdr\fe^, research, techniques - 
. - :(€-gl , a sQcial science ifai^ii ty member);. pTObftM^^ would Be 'upfp% * . • . '1'"^,. 

' V . Tjarthemore^^s^^ one' data colt ec^^^^ .thl^ime : 

neicessfe: to- coU and anai^ze'^he data is /relatively; fcrrie^^^^ hd n^re " " » 

. . than fi^ye' # :fed ei|ht weeks, for da^^ 

■ Direct cbsts> stjcfvf:as . postage^ com^^ material sv :^hd priritin^ - " v 

- : ^^expenses are/alsb rel^^ modest, particularly in'comparisdri'^w 

,5J;djesign.^^ • w^''-,- 

. " ^^^^ ■ ptarining, and ot^riiziiig for^ in Sutdpsyflty^^ ar^e ; V 

: ( l imitedi DniCa the qiiesti^ to be^a^ed ha^e been^specif iedj the fdrve^ fjr'bcedures ^ 
* to tie fallowed are re^^^ str^aight^ fpnv^ : ^ 

: : ^1976^ .fqr/an■ i ^ : . ' 

■ V .^V »^ using an autopsy design' aTsd prbbab^^^^ 

^ ijse fdf ^plarin bt^ ev^ 1 uati on purposes other thai\ those asiociatgiJ w^^ : attM- * ^ 
' • • • tion-;; The^ l imitations proceed from: the absenbezdf a. cdmpari^ori group of nbri- ^ 
. V drdpbuts* the fact 'that most autopsy data are collected after the sti^^ 

withdrawn, and from the' questibnable validity of obtained responses, . - 



^ AsvUsid here;|Mpss-^^^ the. col l ection of •data - 

frorri currently^ enrol 1 ed students at;>^ si ngl e point trlhiej probably late ihsan 



ihd social attitudes and wHo fal V irito^ yarious ; 

cat^^pri^s of. dro^ after" .the start of the ;. 

next'acis[dtfl|itc year. These groups are thert.comti^ir^ed^^ 



ihflUence^ att^^^^^ ajid for whiqh data - have been eoTleeted. -/ "'^ 

Despite the fact that Instrunieht reliability and validity depertd far more 

■ L - ■■ ' ■ ^ .. ■. ^ ■ ^- ^- ^ ■ ■ -/"^ 

an the draining and skill of the res'earcher than o^n the design selected, the • . 

cross-sectipnal plan ijs still niore likely than the autdpsy desip to yield :v 

responses sincei,.in ttie case of leavers, thene is less reason to rationalize a- 

decision tfiat has not yet been made (or at Veast no.t yet carried through). ^ As 

noted earlier, however* no design either guarantees or precludes ,4^equate measurer 

ment.- ' , « " - ■ ■ . ^ - ^ . ' ■ 

* ' ^ Cross-sectioriaiV designs are also,. jDther things being eq^ ' . 

than autopsy. studies to have high^ reSpo^^^ if for no. other reason than. ; 

that the students being surveyed are .still : enrolled and therefore 

to, the resea'rchgr. Students H^hd hive dec^^ to withdraw may hot respond' as *: 

.-t ■ -V. . ■ - y .■ . , -■ . - ' . ' • - ■_ , ■'- ■ .■ . 

readiTj? as those wHb- will stay^ but response ^ rates frbm enrolled students, exce^iding^ 

, . ^ ■ ■ ■ ■ ' ■ y ■ ' ^ ■ ■ , \ > 

50 per cent are not .unusua^l jind. may run as higli as 75-80 iper cent. ' , ; - , 

> Tfef^ representative^ for ' 

a' larger populate It 1^ wbrtH repeating, however, th^t \ 

^wbile neither h^igh respopse rates nor randotn sampling is ^any guarantee of r^espondents* 

."■ ■ ^ ---'^ - -■ ■■ . -■ . - , ■'. ■ ' .- - {■ » ^ ■■ - ■ , - - ■ ■ , J - . . 

reprgsentatiyghasg> the probabiTlty of resul ts being^ general izabl e increases^ with v,* 

■ -•- . ., ^ ■ - ; - _■ ■ ■ --"^v ■. •■'^•■'j - . ^ ■ ■ V-:--' -i-.;-:.'/.^ • • 

the rate; of respbhs^.^ ^ M Idwen response rate amdrig . ' * ^ : 

>;^ttire: dropbuts-;^;^!^^^^ still more i ikelyiv-'': 

with a .cross-sectiorial: design than; with the autopsy plan. : V ' >..X 

'* ■.. . ' • ; ' --v . . ;. . o * ' ' j-. '^fV 

• ; . In the matter of -inte^^ the autdpsj^ study failed pn twD tbUrit^:^ 



the absenee &f a;.cdmparisdh grpUp of riorirdrOpputSi ^a^^ the consequent inability, 
i tO: test or rt^ between studeirits^ anid v / . ; 

^ «th9se.who. do n6t._ the cross-sectionail design has a clear Advantage oyer the U : -: 
^ autdpsy .plan in that it provifles for.- the direct comparisoh of dr^^^ witK non- 

■ ' - _ / ' 1^-:, : ' . -. - .' ' - \ - ' ! ' ' * = ■ 

drdpottts oh the sam^' measures v tsiken^ l^^^ the same time, and under similar cdndi- 

■"■.r ^ • ' ■ 

tipns.> "In 'addition, thi s. design involved the measurement of pptehtial ly attri- 

-.tion-reiaSed ex^^^^^ attitudes at the very time they are presumably ^ 

•exejrtiti^ (Pantages 'S .GreedonV 137 ; ^ ^ ^ 

^ , Threats to the iriterrial vaT^'dity df-the crdss.-sectipriat desfg^^^^^ remain^ y^ 

^ hp.wever:. Uespit^ its prbyisidn fc^^ comparison group", it generally does nbt 

allow the testtng or control of initial group differences. Thus, td the extent 
.' that dropouts and ndh-drdpduts itiay have been different a the fi me of enrol Iment* . \ 

it may be pbssiWe td attribute th^ . attri tidri deeistdri to thdse differences , rather 
. than.to something in the institutidnal environment or^xperi,ence of the students; 

Stufents' admissions files may contain sortie informatfbn useful for controlling: 
^ pre-cdTlege differerices,/but the dppdrturlities fdr such cdntrdls are prdbably:/: 

limited to the infqrmatidri' available in* the fiVes; information relating td :such 
: pdtentTally important predictors^ o^^^ as prefcollege cormiitment^^^^^ I t 

. pletidn of a de^gree, personality traits,. educatidnal. and career aspirations or 

gdals, arid expectatidriSt df the cdllege experierice .prdbably will be uriavailabl?. 
; Jhus, while the xrdss-seetidnaT plan may .1^ tp observations that dropouts arid 

npri-dropoUts.do, indeed; diff say, their attitudes toward. their academic: 

A' - ■ V .. -: • : _ ^ - ■ - - - - .■ - - ^ - - - - _ : 

. prpgramS i . one will not be able to stilte with conviction that they did not differ 
in: ;iiTjpdrtarit w^^ befdre they matriiuTated ;iri the cdllege. j -^^ 

/The analytical procedures brought to bear. data, like 

those used in evaluating autopsy information; are more, a funetidn of the researcher's 
. tj^^aihing and experience than the design selected. Nothing iriherent in the. basic 
desigii requires or proscribes the- use of either bivariite or multivariate statist 
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tical prbcedo^^ a ebmf)i ex process ^ however, arid valid arid i , 

pretabte/PesuTts ^^a^ 1i Rely to result from. a the more 

powfer^:!^^ de5i|rijj^^ to^cdntrdi inUiail^ 

-9^Q^F%di fwferic^^^ (however 1 imite<iv the ayifil abl e ; Tj|ft|^ni^t3ri| ■ 
tical prbcedures will probably Be fi^^ --^ y: ■ . 

. . The train^g and e^p^rierice requi^r^^ staff abou.tv^b.under^ 

. _ . _ _ » . ■ . ... . rf. . .. ... . _ . . 

take a cross-sectional study can vary considerably. A cross-rsectional plan with-^ 
. biit cd|trbls may be as simple arid direct, as the autopsy desigri. But if the strengths 
inherent in the cross-sectional -design tare to be maxiinized (particularly ebritrbllirig : 



for basic pre-college differences), the services pf a reasonably experienced re- 

searcher will probably be needed. / ■ '\ 

While drily one major data cdllectidri is needed^ the crdss-sectidrial plan 

: ericpmpasses the hiatus between academic years and, thus, will prc)b,ably take somewhat 
■'- ■ • ■ »• • ■ ■ , ■ - , . • ' ' • , 

longer than the autopsy study to complete. Somewhere between six and nine months 

may be needed. . . ' " ^ : % 

The direet costs of addptirig a erdss-leetibrial: dfesigri' may be as low as 

those associated with the autopsy study, but c)ri" the average they will probably be 

•somewhat higher. The additional costs are most directly related to the need to - , 

; sample ridri-drdpd^ts as we'iraVdnjpdUtS;^ the likelihood (though riot necessity) of : 
eolleetirig more "information from e^ respbriderit,' and especially (if controls are 
to be applied) from the increased clerical arid machine costs associated with merging 
into a single file the survey data and the information from sources other than the 
re^spdriderits (e.g., admissidris files). 

) The research advantage of th^ erdss-seetibnal design in proyidirig for a 
comparison group of nori-drbpouts has its practical ^counterpart in the opportunities 

, to . make use of the. data for purposes, other than understanding attr^ltidn- Dropouts , 

. ■ ■ . . . , : . , . - 'N . . . • I . . . . ... _ - .- ; 

arid: fid ri be aggregated in drder 'td e>:aifjirie relatioris^ b^ selected 

• -• # . . . . . . \ • - * ■ ■ . ■ ■ 

• _ - - • ■■ ■ _ • ■ - ■ 

student characteristics arid various a or behaviors. For example, . 



brie might compare minority arid riori-miriority group studeritSj corrriutlrig and reslden^^^ 
stadehtsi inaTes arid females ^ or stdderitsiri different academic majors with respect 

i . J__ __j ^_ ■ -L? _ ._ ' 

V to academic^ performance, general atti tudes . toward acadertic or non-acftdefnic programs ^ 

vbrv^yal:^!^ 

attfitibn stu(jy^^^ based .on the crbss-seetidriat^ cag^be made to 

serve a Variety of progrant^ plgnriing^,. anH eval'a pbrposes". .■ ; : : .: ^.1 v;.lj 

Finally,, as one .s'eeks to control initial group differences ;.(ev^^^^ 
drie or twdj^ the amourit of plarining arid the data mariagemerit problems will increase. 
Gbmpared tb* those of a lorigitudirial desigri", however, such demands are stilT relativi 
ly slight. ^' . : - ■ 

THE LONGITUDINAL DESIGN. 
' . A IbngitUdihal design ihvdlyes; the collection of information from the • . 
same students, at two or more points in time. ' Urida^his plari^' data bri eriteririg 
students' iocia:! and educational backgrounds, expects^jori^ college, educational^/ 
and career goals and so on are collgcted prior to (cH^^-a^t the t the students V 

matrieulatibri, Sifnilar data are collected riear the eri4 bf the academic year from 
respondents to the initial survey. (Some longitudinal studies run considerably 
longer than on^ year;, the questions to. be answered determine- both: the timing and 
number of data coll ecti Oris. ) Members of the original sample (or "cohort") who . 
have dropped but at any giveri pbirit (br perhaps dropped but arid returned) ;a^e^Ke^^ 
compared with their nori-drbpout peers on the variables for which iriforma^^^ on 
the .groups, is available. ^ ' : ^'^^''"^--^ 

Response rates^ for lorigitudiriglly desighed studies^ as with cross-sectional 
designs, are likely tb be higher* thari thbse bbtairied in an atitbpsy study. Irideed, 
since entering students (either by habit or ineliriation) are more willing to re- 
spond to requests for information than are enrolled students, representativeness 
of resporiderits fqr the populatiori from wHi eft they come Is most likely for the : 
iriitial ^ata eblleetibn bf a ^Ibrigittidirial ^esigri. However, since subsequeri.t da 



will'bfe collected only from persons who have respbhded to the initial survey, \. 
respdrise rates based on the original sample size will decline as initial re-; 
spphderfts fail to respond to subsequent data requSsts. The^probtera is peculiar 



to th 

•"mortal 



is design; and it is extremelj?^^ this jqereallrig subject 

ality" in mind when determining the oirig^^ s^\e'!' i^-'^'r 

/fliust be large inpugh to Insure that the estimated response- rates fdr each - ' ; 
data collection will yield suf^^^^ respdrid^nts with cpmplete da|a-^^w ; ; ■ 

analj^tical group to; p^nnit stable analyses. The safest rule-bf-thumb : 
with the largest original- sample one can afford. V 

The cumulative: mortal ity ^ - 
tarit implications for the represehtativerie of persons who have responded to all • 
data requests. Clearly, as the percentage of the original sample declines with , 
each data collection, ^the prospects for maintaining response representativeness 
I will also decl ine. ' The simplest sdlution to this problem is to make every effqrt 
to obtain responses members of the original sa dr, in subseqi^ent . — 

data collections, ^ from all persons who have responded to earlier requests. While . 
the methods of adjusting for any unf^epresentativeness which may 'occur as respondent- 
mortality increases are beyond the scope of this 'paper, the problem can be a serious 
one and^warrants attention as the study progresses.: ^ ^ . 

As with the cross-sectional design, the longitudiinal plan* penrtits. cdrTH3ai;;^i-^^ 
sons of varying kinds of dropouts with non-dropouts. A l^figitudirTal design has 
tire added advantage, however, of permitting the ext-ensive control of pre-college 
differences between dropouts and nbn-dropbuts since the initial survey will yield 
far more information on students' pre-college backgrounds, attitudes and experiences 
Han is Hkely to be available in the admissions files. For -this reason, the 
"lehgittidinal plan is the most internally val id design of the three. In effect, 

e pre-college information can Be iised statistically to equate dropouts and non- 
dVo pouts :. on such characteristics ias ^ex, academic aptitude, high school ' achievement. 
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" ' •personality traits ihd expectations &f college before the search for "insti- 
^i- tUtibrial' eoritHiDutibhs" to attritio^^ i^ begun (see Kerlinger & Pedha2ur»^973 ): 
By comparison with t^e autopsy ar>d erbss-seetibrial plaris^ the ldW\^udina 
: attrition study design' is as inteiFnally val id 'as one might hope to fiftd in 

soiiisl science' survey research^/ ■ / v "^V ^ / *^ ^ ^ . 

As we have seen. However/ every d^esi^^^ ^xactsvits. price, the longitudinal' 
approach may be the most methodologically^ soand, but; it^s aU the mbst-«xpensive.' 
v Its adoption will ^require a- research staff (or at least qne. person) with well- 
developed social science research skills/ including familiarity with sampling 
* • designs^ instrument cbhstr^tion, mtfl tidimehsidria'tvscal ing^ purvey research rrgthod- 
ologyi and multivariate statistical analysis. ^ 

The time needed tg complete a longitudinal study is also substantially 
7 longer than foy either the cross-sectionkl or autopsy desi-gns; it seems unlikely 
' that a iDnqitudinaT study of any shorter duration than one year would provide much 
useful information on attrition. The time lapse between study initiation arid^^pre- 
liminary 'results in a one-year study can easily, take fifteen, months. « 

Direct costs will also be higher for a longit^udinal study. The higher 
price is assbcia^ with the need fbr larger samples and m^re mailings, increased :x 
coding volume, la^er numbers' of instrum^hts, and computer^costs. . * ^ " ' 

Other planHmg considerations include the increased need for careful study 
design, instrument development, and/sampTing desigri;^ Dependijig ^on the availability^ 
of suitable computer software^ the^^^j^if^? management prbblems of merging files of 
\ unequal sizqs can be burdensome. Filfe merging operations -that cannot /tie done by 
. machine \yi 11 have to be done manual^^,\ adding to the time and clerical assistance ; 

'.required.' \ ' " ( ' ' ' ' ' ' 

Ihstitutions that participate in national prercol lege student infdrmatidri V 
, programs, s^h as the Cooperative Institutional Research Program (sponsored jbintly 
by thi,AmerK:)in Couh on Education and the University of Cafifornia at Los Angeles), 



^' or the American College'Testing Progr^^^ Program ^^ha^v^^^^ aeeided^ 

. advilritage d^er institutions which do not. Th# avail abijitj? of pre-college 
, infbrmatibri'bri students' yielded by such prograins obviates the need f&r ^anl 7^ 
additional data collection. ' - ^ ■ ' ■ ' ^ - ; ' 

■ , CONCLUSIONS - . vr. - 

■ ■ ' • ■■ — ' ; " rv:' ■■• ,■ ■ ■ .■ ' ■ ':■ ■ ■' ■'"C- ■ ■ ■ 
'■ BSth before arid after'A.a .cjesigri is sglected^ it; is imptjrtant to: keep in ; 

inind; that i without exception, attrition ittidi el are ebrrelatidnaTV^.^f^^ " 

. connections can be made between or ambhg variables and students' 'attritibn 

- decisions. The finding that a given variable is statistically relHed'tb attri- 

. tidn is a statement about the 1 ikel i hood that the^^^oteervpd^ is ^due .to 

chance; it 'is not a: statement rof cause and effect; Identifying tausal linkages 

in the attrition process is, foT: the preserit at l^east,- beyon^^^e :capablTft>es gT 

social sciende researcf?. ~ . . ^ 

While rio'attritidn study design is. 'without its flaws^^t seems clear that 

the autopsy design, from a research pbint of .view, is the weakest design rgvi-ewed • 

here. Despite its appealing simplicity and straightforwardhess, it :sim^ 

add to Understanding of a compiex issue: why students drbp out. ^'Response rates*' 

.'• . - ^ . .... ■ ^ . 

. - . ■ _ _ ^ _ _ _ J _ _ _•_ _ ■ _ _ ■_' ^ _ ' . ■ 

are typically low, diminishing the df general izable results; r^sporjses 
received are: open to questions of val-idity; and :proyisibn is typically hdt made , - 
^or comparison? of dropouts a>id non-drorpouts, leaSihg'tb uhacceptably low design . 
internal validity, t^hile the autopsy study is the- least expensive design and the 
only bne tM^ will peVmit estimatidh *df the prdpbrtidri of dropduts whd left be- ; 
:ause they had" achieved what they had cbfne for, tfese assets ' simp3y dd not cpUhter- 
; balance its conoiptualvand methodbTbgical weaknesses.' Probably its only utility 
is as a supplelnent to •information collected using another design. • 

The crdssrSettTdnal design" represents sdmething of a cdmprdmise between a 
research fdeal and practical cbhstrairits bh. resources! Gompared to ttie autopsy 

Q ■ - ■' '4 : , • ^ i * , . . 

ERIC"-'; ■■„'; r^Vv ' ^ . ■ . , : . \ : 



. des'igrii' tfie.crdssTsect^^ p1i.n is more likely to produce acceptable response; " 
rales and the concomitant generalizabjlity of results. COmpirisoris of drbpcidts : 
and nofi^dro'poiiti,«re providid for^ as are bppbrtunitfes to make wider use of ,the 

• information: collected; Relative to the. autopsy design, the cross-sectional plan's 

• price takes ttie fbnn of higher direct cOstsi need ^ for a rqbre-skilled rpearch 

■ . staff , . and for great^^^ care in planning and 'study disigri. (It Wlfes demanding^ 

than the •Tj5na1tudiria.T\design in all these respects, ■) Its p flaw lies in 

. the lack of oppo^^^^^ to cbntrbl; for possible prii--col lege differehces b&tween 

d_rppbuts and rTb«:-drbpgujEs; 'this internal validity weakness can cbnfound the -m-. 
terpretation of results and possibly lead to . ineffective administrative actibh. V ;" 

— From a strictly, research point bf View, the longitudinal design is clearly 

- ■ • . ' , ■ . ■' . ' 

the- most' desirable^^ instrument. reliability arid validity 

..are likely^to be less troublesome; respbnse rates are likely to be acceptable (even 
thougfi they may decline over repeatojd nlea$uremefits); arid sample representativeness, 
while itimay be a problem, can fee dealt with;' eorriparisoris of Bropouts and rion- 
dropouts, as with the cross-sectional desigri:^ are possible, but witj}^ a longitudinal 
design t^iey cari4 b§„made under more controlled conditions. The Use of multivariate 
statistical procedure? (.not. 'precluded from u^e iri crOss-seetibnal studies) are 
particularly suited tb the analysis bt longitudinal, data and permit careful as'sess- 
.men t. of the rMative" 'importance <)f in features and student experiences ■ 

and attitudes after- contrbl ling for 0re-co1 lege; student charactefistics which mayi 
in themselves, irifl;Uence_attnition. - .Institutional cbntributibhs to attrition can 
be mpre clearly delineated and assesseci when Ibhgitudinal data are -used. ; Results 
will have- greater potential for valid interpretation and for wider administrative 
arid planning ati.lity. ' , .. - 

. " these decided research advantages come at a relatively high: price, however. 
Skilled research personnel are needed; the time td^ complete ..pe. study is If kely to 
be fifteen Or mre months;, direct cb^ts. wTlV.be higher; greater: planning will be 



required, and data riianagenient p^^^^ will be greater'' and more numerous. : 
In the last analysis^ of course^ it is the investiptdr and the ih^titutidh 
who must strilce, ^ahd then live with^ the balance betwe^^ design properties - 
and available resoi^ces^:. : r 7 ,• 
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